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Abstract- This paper aims to develop the stability theory for singular stochastic Markov 
jump systems with state-dependent noise, including both continuous- and discrete-time cases. 
The sufficient conditions for the existence and uniqueness of a solution to the system equation 
are provided. Some new and fundamental concepts such as non-impulsiveness and mean 
square admissibility are introduced, which are different from those of other existing works. 
By making use of the "H-representation technique and the pseudo inverse of a singular 
matrix E, sufficient conditions ensuring the system to be mean square admissible are estab¬ 
lished in terms of strict linear matrix inequalities, which can be regarded as extensions of 
the corresponding results of deterministic singular systems and normal stochastic systems. 
Practical examples are given to demonstrate the effectiveness of the proposed approaches. 

Index Terms- Singular stochastic systems; stability; "H-representation; matrix inequalities. 

I. Introduction 

Over the past years, a great deal of attention has been paid to singular systems because of 
its extensive applications to many practical problems, such as electric circuits [[U, economics 
[2-3], aircraft modeling [4], network theory [5-6], robotics [|71 and so on. To date, many 
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significant notions and results based on state-spaee systems, for instanee, stability analysis 
[8-12], robust eontrol [9-13], H^o control [12, 14], H^o filtering [12, 15], H 2 /H 00 control 
[16], have been sueeessfully extended to singular systems. 

On the other hand, in reeent years, there have been increasing interest in the singular hybrid 
system driven by Markov jump parameters as 

Ex{t) = A{r{t))x{t),xo G i?". (1) 

This is beeause system (1) ean be used to model systems with strueture ehange resulting 
of some inner discrete event such as component failures or repairs, abrupt environmental 
disturbances [17-18]. More efforts have been done on stability analysis related to system (1), 
and a variety of interesting results have been reported, we refer the reader to [17-22] and the 
references therein. 

Nevertheless, it is noted that the system is often perturbed by various types of environment 
noises in many branehes of seienee and industry [23-27]. If we take the environment noises 
into account, system O becomes a singular stoehastic differential equation with Markov jump 
parameters, whieh ean be represented as: 

Edx{t) = A{rt)x{t)dt + C{rt)x{t)dw{t), (2) 

where w{t) is one-dimensional, standard Wiener proeess. Such systems are mueh more 
advaneed and realistie, whieh possess all the eharaeteristies of singular systems, Ito equation, 
as well as hybrid systems. It should be pointed out that, so far, only few works were done 
on this elass of systems as a result of the influence of the diffusion term. In faet, there are 
some diffieulties in generalizing the results of deterministie singular systems to singular Ito 
systems. For instance, how do we provide the eondition for the existenee and uniqueness 
of the solution to the system equation? how do we introduee the non-impulsiveness and 
admissibility of system (2)7 For the cases of system (2) with or without Markov jump 
parameters, some articles either assumed that the solution of the system equation existed 
[28] or direetly considered that the regularity and non-impulsiveness of system (1) were the 
same as system (2) [29-30], which completely ignored the erueial aetion of the diffusion 
term C{i). Also, as pointed out by [31], the applieation of Ito formula to system (2) without 
Markov jump parameters was improper [28-29]. Reeently, for system (2) in the absence of 
Markov jump parameters, ll3^ laid a solid foundation for the further study of this topie as 
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Ito formula was exactly applied to such systems; |[^ further investigated the observer-based 
controller design by using a sequential design technique. In ll34]l . based on the results of the 
singular Markov jump system (1), a sufficient condition for the mean square admissibility 
of system ([2l) was given in the form of non-strict linear matrix inequalities. This may cause 
a big trouble in checking the conditions numerically. Base on the above analysis, it can be 
found that, up to now, the problem of stability analysis for continuous-time singular stochastic 
Markov jump systems with state-dependent noise has not been fully investigated, even for 
the discrete-time case, which motivates us to do this study. 

In this paper, we are concerned with the problem of stability analysis for singular stochastic 
Markov jump systems with state-dependent noise including the continuous- and discrete-time 
cases. Conditions for the existence and uniqueness of the solution to the system equation are 
given. The new definitions for non-impulsiveness and mean square admissibility of systems 
considered are introduced, which are different from those in existing works [28-35]. An 
equivalent conversion of singular stochastic Markov jump systems with state-dependent noise 
into standard and deterministic singular systems is obtained by using the 3^-representation 
technique, then the sufficient condition for system considered to be mean square admissible 
is presented in strict LMI, which is less conservative than that in ll34l . Furthermore, with 
the help of the the pseudo inverse of the singular matrix E, new conditions for the 
mean square admissibility of the continuous- and discrete-time singular stochastic system 
with state-dependent noise are formulated as strict LMI. The results obtained can be viewed 
as extensions of the corresponding results on stability of deterministic singular systems and 
normal stochastic systems. Finally, illustrative examples are given to show the effectiveness 
of the proposed results. 

Notations: R^: space of all n- dimensional real vectors with usual 2-norm || ■ ||; 
space of all m X n real matrices; S'„: set of all n x n symmetric matrices; S^: set of 
X = ■ ■ ■, X{N)) with X(f) e Sn,i = A > 0(resp.A < 0): A is areal 

symmetric positive definite (resp. negative definite) matrix; the transpose of A; vec{-): 
the row stacking operator; A® B\ the Kronecker product of two matrices A and B; E^\ the 
Moore-Penrose pseudo inverse of the matrix E\ E(-): the expectation operator; the nxn 
identity matrix. R{A): the rank of A. 
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II. Preliminaries 


Let us consider the following continuous-time singular stochastic Ito’s system with Markov 
jump parameters: 

{ Edx{t) = A{rt)x{t)dt + C{rt)x{t)dw{t), 

Ex{0) = Xo G i?", 

where E is a constant n x n-dimensional matrix with rank{E) = r < n\ x{t) G is 
the system state vector, xq G i?" is the initial condition; w{t) is one-dimensional, standard 
Wiener process that is defined on the filtered probability space (f2, E, Et, R) with a filtering 
{ftE > 0} is a right continuous homogeneous Markov chain taking values in a 
finite state space S' = {1, • • •, N} with transition probability matrix = {vrjjjjvxA given by 


Ej = p{rt+h = j\rt = i} 


TTijh + o{h),i ^ j, 

1 -f TTiih + o{h),i = j, 


(4) 


where h > 0, limh^Q o{h)/h = 0 , and > 0 (f 7 ^ j) represents the transition rate from i to 
j, which satisfies ttu = - 

For the sake of discussion, we introduce two operators 0 : and 'll; : 

n(n+l)iV 

R 2 which are defined as follows: 


0(X) 


vec{X{l)) 


svec{X{l)) 


MX) = 


vec{X{N)) 


svec{X{N)) 




(5) 


where uec(X(f)) = (xii(i), • • •, • • •, • • •, G i?"", snec(X(f)) = (xii(f), 

• • ■ ,Xln{i)E22{i), ■ ■ ■E2n{i), ' ' ' , Xn-l,n-l{'i), Xn-l,n{i), Xnn{i)Y' G , Xks{i){k, S = 1, 

2, • • • ,n) is the element of X{i). Note that svec{X{i)) is derived by deleting the repeated 
elements of vec{X{i)). By Definition 2.1 of ll27ll . the relation between svec(X(i)) and 
vec(X(i)) is given via vec(X(i)) = HnSvec(X(i)), where Hn is a x -dimensional 
matrix independent of X{i). 

By Lemmas 2.1, 2.3 and 2.4 of [l27ll . the following result can be easily obtained. 

Lemma 1: (i) For any X G SY there is a lEN x 'AxEXjsj matrix independent of 
X such that 4>{X) = H^'ijj{X), where = diag{Hn, ■ ■ ■ ,Hn). Conversely, for any Y G 
Rn^Nx there is X G such that (j){X) = H^Y, (ii) is nonsingular, i.e., 

has full column rank. 
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Lemma 2: Let Zi, Z 2 e if = {H^fcjyiZ^), then 0(Zi) = 0 (^ 2 ). 

Proof: By Lemma l-(i), 0(Zi) = Hl^i^{Z{), ^{Z^) = H^i^iZ^). From (H^fcPiZ^) = 
{H^Y(j){Z 2 ), we have 

By Lemma l-(ii), the above formula yields ip{Zi) = ip{Z 2 ), which is equivalent to 0(2’i) = 

0 (^ 2 ). 

The next lemma plays a crucial role in this paper, which guarantees the existence and 
uniqueness of the solution to system (3). 

Lemma 3: If there exist a pair of nonsingular matrices M{i) G and N{i) G 

for every i G S' such that one of the following conditions is satisfied, then system ([3]) has a 
unique solution. 


(*) 


M{i)EN{i) 


Li(*) 0 

0 




M{i)C{i)N{i) 


Cllii) Ci2(z) 
0 0 


AiRi) 0 
0 In2 {i) 


(6) 


where Nn^ii) G i?’^2xn2 ^ nilpotent, = 0, y 4 ii(i), C'ii(f) G ^ 

RiT-iX^ 2 ^ni + 77,2 = n. 


m )[341 M{i)EN{i) = 

Ir(i) 0 

,M{i)A{i)N{i) = 

Ailii) 0 



0 0 



- 1 

1 

0 

_ 1 



Ciiii) 

Ci2{i) 



M{i)C{i)N{i) -- 
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0 

C22{i) 




(7) 


where Aii{i),Cii G R''^A Ci 2 {i) G , (0220) G / 2 (’^-Ox(n-r)_ 

Proof: The proof of item (ii) can be found in Lemma 2.2 of Il34ll . As to (i), let ^{t) = 
N{i)~^x{t) = ^ then under condition (i), system 

(3) is equivalent to 

= Aii{i)^i{t)dt + (C'ii0)6(^) + Ci2{i)i2{t))dw{t) (8) 

and 

Nn2iA)di2it) = i2it)dt. (9) 
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Take the Laplaee transform on both sides of dH), we have 




( 10 ) 


From (fTOl) . we obtain 


6(s) = (siV„,(^)-J)-'iV„,(^)6(0). 


( 11 ) 


The inverse Laplace transform of ^ 2 ( 5 ) yields 


h-l 




( 12 ) 


where L[5^{t)] = s*. 

After substituting (fT^ into ([8]), ([8]) becomes an ordinary stochastic differential equation. 
By Theorem 3.8 of ll24ll . the solution of dS]) exists and is unique, so does (3). 

Remark 1: A new condition for the existence and uniqueness of the solution to system 
(3) is presented in Lemma 3. When Nn 2 {i) = 0, condition (i) is exactly the same as Remark 
2.1-(I) of [[ 34 II . When C{i) = 0, condition (i) reduces to the corresponding result for the 
singular Markov jump system (see ifTSll . ifTTll - (221). 

In what follows, we introduce several concepts which are essential in this paper. 

Definition 1: System (3) is said to be impulse free if Lemma 3-(i) with deg{det{sE — 
A{i))) = R{E) or Lemma 3-(ii) hold for every i G S'. 

Definition 2: System (3) is said to be asymptotically stable in the mean square if for any 
initial condition xq G R^, lim^^oo IE{||x(f)|p|a;o, ro} = 0. 

Definition 3: System (3) is said to be mean square admissible if it has a unique solution 
and is impulse-free and asymptotically stable in the mean square. 

Remark 2: As it is observed that Definition 1 for the non-impulsiveness of singular Markov 
jump systems with state-dependent noise includes the diffusion term C{i), which is firstly 
introduced and different from all the existing works ( (281 - (35l ). Also, it is obvious that the 
non-impulsiveness of system (3) implies that system (3) has a solution, which coincides with 
deterministic singular systems; see, e.g., (H and (T^ . In the cases of C{i) = 0 and S = {1}, 
Definition 1 and Definition 3 degenerate to the corresponding definitions of deterministic 
singular systems ( (51- (Tbl f. 

Parallel to the results of deterministic singular systems on the non-impulsiveness behavior, 
the following proposition is obtained. 
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Proposition 1 System (3) is said to be impulse free if one of the following eonditions 
holds. 

(i) deg{det{sE — ^(i))) = RiE) in 

(ii) iV„ 2 (i) = 0 in ©. 

{m)A 22 {i) in the following (13) is invertible and R{E,C{i)) = R{E), 


M{i)EN{i) = 

Iril) 

0 

,M{i)A{i)N{i) = 

A\i{i) Ai2{i) 


0 

0 


A2l{i) A22{i) 


M{i)C{i)N{i) = 


(13) 


0 0 

where M{i) and N{i) are invertible matriees. 

Proof: We will prove that eonditions (i)-(iii) are equivalent. 

[i] {a). If dH) holds, then det{sE — A{i)) = det{sInAA ~ Aii{i))det{sNnAi) ~ 

But deg{det{sE — A{i)) = R{E) = r implies iV„ 2 (*) = 0 and rii = r. 

(a) (i). It is easy to see that NnAA = 0 in db]) implies deg{det{sE — A(i))) = R{E). 

(in) ^ (i). Since R{E) = r and R{E,C{i)) = R{E), it is always possible to choose two 
nonsingular matrices M{i) and N(i) such that (13) holds. If A 22 {i) is invertible, there are 
nonsingular matrices M(i) and JV(i) such that 


M{i)EN{i) = 

M{i)C{i)N{i) = 


Irii) 0 

,M{i)A{i)N{i) = 

Aii{i) — Ai2{i)A22 {i)A2i{i 

0 

0 0 


0 

^n—r ('^) 


(14) 


Ciiii) — Ci2ii)A22 {i)A2i{i) Ci2{i) 

0 0 
Obviously, deg{det{sE — A{i))) = R{E) in db]). 

(i) =» (in). By (^) {ii), Nn^ii) = 0 in db]) implies R{E, C{i)) = R{E). Furthermore, there 

are nonsingular matrices M{i) and N(i) such that (13) holds. As a result, deg{det{sE — 
A(i))) = deg{det{slr{i) — Aii{i))det{—A 22 {i))- By deg{det{sE — A{i)) = R{E), we have 
det{A 22 {i)) A A 22 {i) is invertible. 

The following lemma will be used later. 

Lemma 4 Il36ll : For any three matrices A, B and C of suitable dimensions, vec{ABC) = 
{A®C^)vec{B). 


III. Stability of continuous-time systems 

In this section, we will focus on studying the stability of system (3) via two different 
approaches. One is to apply the "H-representation technique in GTll to improve the existing 
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results of |[34l . and the other one is to establish striet LMI eonditions for the stability of 
system (3). 

Theorem 1: System (3) is mean square admissible if the following system 

= A^PiXit)) ( 15 ) 

is admissible, where (flSl) is an jV-dimensional deterministie singular system, 

£ = {H^fdtag{E E)H^, 

^ = {H^f[diag{A{l) ®E + E® A(l) + C(l) (g) C(l), • • •, A{N) ® E 
+E ® A{N) + C{N) ® C{N)) + (n «) In2)diag{E ®E,---,E® E)]H^, 

Xi{t) =E{x{t)x{t)'^X{rt=i}},X{t) = {Xi{t), - ■ ■ ,XN{t)), 
and x{t) is the trajeetory of (3). 

Proof: For (3), let Xi{t) = E{x{t)x{t)'^X{rt=i}}^ then use the generalized Ito’s formula 
m, we derive 

N 

EXi{t)E^ = A{i)Xi{t)E'^ + EXi{t)A{if + C{i)Xi{t)C{if + ■ (16) 

i=i 

Take vec(-) on both sides of (fT^ . we obtain 

N 

{E 0 E)vec{Xi{t)) = {A{i) 0 E’ + ® A{i) + C{i) 0 C{i))vec{Xdt)) + ^ 0 E)vec{Xj{t)). (17) 

j=i 

(fTTl) can be equivalently written as 

diag{E 0 E, • • •, E 0 E)4){X{t)) = [diag{A{l) (i) E + E ® A(l) + C(l) 0 (7(1), • • •, 

A{N) 0 E + E 0 A{N) + C{N) 0 C{N)) + (H 0 I^2)diag{E 0 E, • • •, E 0 E)]<3(X(i)). (18) 

Premultiply (fTSl) by , then by Lemma l-(i), we have 

{HPpfdiagiE 0 E, ■ • •, E 0 E)HPp'P{X{t)) = f[diagiA{l) 0 E + E 0 A{1) + (7(1) 0 (7(1), 

• • •, A{N) 0 E + E 0 A{N) + C{N) 0 C(N)) + (H 0 E2)diag{E 0 E, • • •, E 0 E)]HppiP{X{t))(l9) 

Let 

£ = {H^fdzag{E ®E,---,E® E)HY 

A = (H^fldiag(A(l) ®E + E® 7l(l) + C'(l) (g) C'(l), • • •,7l(iV) ®E + E® A(N) 
+C(N) ® C(N)) + (n 0 I, 2 )dmg(E ®E,---,E® E)]E^, 
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(fT^ is converted into (fTSl) . Sinee 

lim = 0 ^ lim (j){X{t)) = 0 

t^oo t—)-oo 

lim X{t) = 0 lim E{||a;(t)|p|xo, To} = 0, 

t^OO t^oo 

if (fTSl) is admissible, then system (3) is mean square admissible . This eompletes the proof. 

Remark 3: It is shown that (fTSl) is a deterministie but not a standard singular system, 
beeause (p{X{t)) contains repeated or redundant components. Generally speaking, for sueh 
a nonstandard system, some elassieal eriterions do not hold [|27]| . this is why we introduce 
Lemmas 1-2. 

Remark 4: Compared with the equation (9) of lf34]| . singular stoehastic systems (3) in this 
paper is equivalently eonverted to a deterministie ]\f -dimensional “standard” singular 

system (15). In this ease, we ean direetly make use of the existing results of deterministie 
singular systems sueh as Theorem 2.2 of [12] to provide the striet LMI eondition for the 
mean square admissibility of singular stoehastie system (3). 

Corollary 1: System (1) is asymptotieally mean square admissible if there exist matriees 
V > 0 and Q sueh that the following inequality 

{VS + SQfA + A^{V£ + 5Q) < 0 (20) 

holds, where S is any matrix with full eolumn rank and satisfies S^S = 0. 

Remark 5: Theorem 1 tells us that we may make use of the existing results of system 
(fTSl) to diseuss the stability of system (3) provided that both (3) and (fTSl) have solutions. 
Theorem 1 is not eonvenient to be used in studying stabilization, LToo control and other topics 
of system (3), whieh motivates us to develop other methods. 

Assumption 1: For every i e S, R{E,C{i)) = R{E) holds. 

Lemma 5: Consider system (3) with initial state (xo,f) E R^ x S. If V{x{t),t,rt) = 
{t)E'^P{rt)x{t) with E'^P{rt) = P^{rt)E, then for any t > 0, 

E{ f CV{x{s), s,rs)ds\ro = i} = '¥j{x^{ t)E^P{rt)x{t)\rQ = i] — x'^{0)E^P{i)x{Q), (21) 

Jo 

where 

CV{x{t),t,rt) = x'^ {t)[A'^ {rt)P{rt) + P'^{rt)A{rt) 

N 

+ J2Trr,jE^P{j) + C^{rt){E+fE^P{n)E+C{rt)]x{t). (22) 

i=i 


9 



Proof: By generalized Ito’s formula in ll^ and Theorem 2 of If^ . the above lemma can 
be verified. 

Theorem 2: System (3) is mean square admissible if there exist matrices P{i) for each 
i G S' such that 


E'^P{i) = P'^{i)E > 0, 

N 

A^{i)P{i) + P'^{i)A{i) + ^TTijE'^ P{j) + C^{i){E+YE'^P{i)E+C{i) < 0. 

i=i 

Proof: (i) First, we will show that system (3) has a solution and is impulse free. 
Under Assumption 1, there exist a pair of nonsingular matrices M, N such that 


MEN = 


(23) 

(24) 


Ir 0 


Aii{i) 

Ai2{i) 


,MA{i)N = 



0 0 


A2i{i) 

^22(*) 


MC{i)N = 


Gll(*) Ci2^) 
0 0 


(25) 


where the partitions have the appropriate dimensions. From (1231) and (1241) . we derive 


N 


A^{t)P{i) + P'^{i)A{i) + Y, ^^jE^PU) < 0. (26) 

j=i 

and (l26l) show that (U, A{i)) is regular, impulse free and A 22 (i) is invertible (see Theorem 
10.1 of dll). Let 


M{i) = 

we have 

M{i)EN{i) = 


I -Ai2{i)A^^{i) 
0 ^ 22 ^(*) 


M, N{i) = N 


I 0 

-A^2^(i)A2i(2) / 


(27) 


Ir 0 

, M{i)A{i)N{i) = 

Aiiii) — Ai2{i)A22{i)A2i{i) 0 

0 0 


0 / 


M{i)C{i)N{i) = 


Gii(*)-Ci2(*)A2-2'(z)A2i(z) (7i2(z) 

0 0 

It is shown that (1281) satisfies Proposition l-(ii), so (3) has a solution and is impulse-free, 
(ii) Below, we will prove that system (3) is asymptotically stable in the mean square. 
Let 


(28) 


N{i) ^x{t) = [iiitY 


(29) 


10 


















where ^i{t) G K^,^2{t) G -R” then system (3) is equivalent to 

d^i{t) = (Aii(z) - Au{^A22{^A2i{i))^i{t)dt 
' +{Cii{i) - Ci2{i)A2i{i)A2i{A)^ii't)dw{t) (30) 

Ut) = 0 . 

V 

Let 




-P2l(*) P22{i) 


(31) 


(1231) and (l2^ imply Pii{i) = -Pn(i) > 0,Pi2(i) = 0. The Lyapunov funetion eandidate is 
seleeted as 


V{x{t),t,rt) = {t)E'^ P{rt)x{t) = ii{t)Pii{rt)ii{t). (32) 

Take the expeetation on both sides of (l32l) . we obtain 

A„.M(Ai(rt))E(||ei(t)in < ny{<t)A.n)) < A^ax(Ai(rt))E(||6(t)in. (33) 

From (l22l) and (l24l) . there exists a positive eonstant 6 sueh that 

nPV{x{t),t,n)) < -0E(|la:(t)||2). (34) 

Using (l29l) . we have 

A,„.„(iV^(ri)Ar(r*))E(||ei(t)in < E(|la:(t)|n < A™„,(iV^(n)iV(rt))E(||ei(f)in. (35) 

Therefore, 

E(/:U(a;(f),f,n)) < -eX^,n{N^{n)N{rt))E{Ui{t)f). (36) 

We define a new funetion (/(t) = e^^V{x{t),t,rt), then 

dU{t) = pe^^V{x{t),t,rt)dt + e^^dV{x{t),t,rt). (37) 

By the theory of stoehastie differential equations, E(||^i(f)|p) is continuous and bounded on 
any finite horizon [0,f], so do E(U(x(t), t,r^)) and E(£l/(a:(t),f,r*)) due to (|3^ and (l36l) . 
Hence, we can proceed to integrate and take the expectation on both sides of (1371) . which 
yields 

E(U(f)) = E((/(0)) + [ peP^E{V{x{s),s,rA)ds+ [ e^"E(£U(x(s), s, r,))ds. (38) 

Jo Jo 
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Substitute (1^ and (1^ into (1^ . we derive 


(Pii(rt))}e^*E(||^i(t)|p) < / ef’"{pmaXr,es{>^7naxPn{rs)}}E{\\^i{s)\\^)ds 


e"*{0m*n,^e5{A™in(iV^(r,)iV(r,)}}E(||ei(5)||^)ds + E(t/(O)). (39) 


Select an appropriate p which satisfies p < » we have 


E(iieiWiP)< 


m.axT^^s{^maxPii{rt)} 

E(t/(0))_ ^ ff(0)fii(ro)6(0) 

minr,^s{>'minPu(rt)} fnaXr,es{Ami„Fii(r()} 




Let 7 = 


maXr„f=s{XmaxPll{ro)} 




mirir^ 6s{A,„i„Pii(rt)} 


minr^(is{>^minPii{rt)} 

, (ITO becomes 


(40) 


E(||6WlP)<7e-^*E(||6(0)|p 


(41) 


Take limit on (Hdl) . we obtain 

limE{||6(t)ir} = 0. (42) 

£—>-cx) 

By Definition 2, (l30l) is asymptotically stable in mean square sense, so does (3). According 
to Definition 3, system (3) is mean square admissible. 

Note that (l23l) contains equality constraints, which are usually not satisfied perfectly when 
solving them via LMI toolbox. To this end, the following theorem provides a sufficient 
condition for system (3) to be mean square admissible in terms of strict LMIs. 

Theorem 3: System (3) is mean square admissible if there exist matrices P{i) > 0, Q{i), 
for each i E S such that 

N 

A^{i){P{i)E + FQ{i)) + {P{i)E + FQ{i)fA{i) + ^ Tr,,E^P{j)E + C^{t){E+fE^P{i)EE+C{i) < 0 , 

i=i 

(43) 

where F E is any matrix with full column rank and satisfies E'^F = 0. 

Proof: Let P{i) = P{i)E + FQ{i), it is easy to verify that 

E'^P{i) = P'^{i)E = E'^P{i)E > 0, (44) 

N 

A^{i)P{i) + P'^{i)A{i) + ^ TiijE^Pij) + C^{i){E+fE^P{i)E+C{i) < 0. (45) 

i=i 

By Theorem 2, system (3) is mean square admissible. 

Remark 6: When E = I, obviously, F = 0. In this case. Theorem 3 still coincides with 
the stability theory of ll2^ on state-space stochastic systems. When S = {!}, i.e., there is no 


12 







Markov jump parameters in system (3), Theorem 2 accords with Theorem 1 of (SSI. When 
C{i) = 0, Theorem 3 degenerates to the criterion for the stability of singular Markov jumping 
systems in [l2T]l . 

Remark 7: It is noted that, under the assumption R{E,C{i)) = R{E), Theorem 2 pro¬ 
vides the sufficient conditions for singular stochastic systems to be mean square admissible. 
The assumption condition is less conservative than all the previous works (see, e.g. If3^ - 
mx where Theorem 6.1 of ll35ll was based on the assumption that deg{det{sE — A)) = 
R{E),det{sE — A) ^ 0, and R{E,C{i)) = R{E), while Theorem 1 of ll3^ just omitted 
deg{det{sE — A)) = R{E). On the other hand, since Theorem 2 includes equality constraints, 
this may lead to computational problem in testing them. To overcome this difficulty, the 
sufficient conditions for the mean square admissibility of system (3) is formulated in terms 
of strict LMI in Theorem 3. The strict LMI conditions obtained are completely different from 
those in [|29l . [[30ll . [l3^ - lf35]l . which are not only easily to be tested by Matlab toolbox but 
also provide a useful way to investigate other control problems such as state feedback, Hoo 
control and El 2 /H^ control that have not been fully discussed yet. 

IV. Stability of discrete-time systems 

Consider a class of discrete-time singular stochastic systems with Markov jump parameters: 


Ex{k -f 1) = A{rk)x{k) + C{rk)x{k)w{k), 

a:(0) = Xo e 7?”, 


(46) 


where x(t) G i?" is the system state, xq G R^ is the initial condition; £' is a constant n x n- 
dimensional matrix with rank{E) = r < n; w{k) G i? is a wide stationary, second-order 
process, E(te(/c)) = 0 and E,{w{k)w{s)) = 6ks with 6ks being a Kronecker delta; the parameter 
Tk represents a discrete-time Markov chain taking values in a finite set S = {1, • • •, iV} with 
transition probabilities Pr{rk+i = j\rk = i} = Xij, and the transition probability matrix is 
given as /\ = {AijjTVxiv, where > 0 and satisfies ^ij = 1 for any i e S. 

To avoid tedious repetition, results for discrete-time systems are only listed without any 
proof unless necessary. 

Lemma 6: If there exist a pair of nonsingular matrices M{i) G and N{i) G for 
every z G S' such that one of the expressions db]), © holds, then (l46l) has a unique solution. 

Parallel to the continuous-time case, the following definitions for discrete-time stochastic 
singular system (l46l) are presented. 
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Definition 4: System (|4^ is said to be causal if Lemma 3-(i) with deg{det{sE — A(i))) = 
R{E) or Lemma 3-(ii) holds for every i e S. 

Definition 5: System (l46l) is said to be asymptotically stable in the mean square if it has 
a unique solution and for any initial condition xq G K^, limfc^.ooIE{||a:(/i;)|p|a:o,ro} = 0. 

Definition 6: System (|4^ is said to be mean square admissible if it has a unique solution 
and is casual and asymptotically stable in the mean square. 

Following the similar lines as those presented in Theorem 1, we can obtain the following 
result readily. 

Theorem 4: System (l46l) is mean square admissible if the following system 


Sij{X{k)) = A'ilj{X{k)) (47) 

is admissible, where (l47l) is an ^^^^^^tiliV-dimensional deterministic singular system, 

£ = {H^fdzag{E 0 E, • • •, E ® E)H^, 

A = 0 R^)diag{A{l) 0 A(l) + C'(l) 0 C'(l), • • •, A{N) 0 A{N) 

+C{N)^C{N))H^, 

X,{k) =E{x{k)x{kfx{r,=i}},X{k) = {X,{k),---,X^{t)). 


Now, We present new sufficient conditions for the admissibility of system (|4^ in the form 
of LMIs. 

Theorem 5: System (|4^ is mean square admissible if there exist symmetric matrices 
P{i) = P^{i) for each i G S such that 


E^P{i)E > 0, 


N N 

-4’'(»)(5]Ai,F(j))A(t) + C’'(t)(y]Ai,F(j))C(i) - E^P{{)E < 0. 

i=i i=i 

Proof: (i) Our first aim is to prove that (|4^ has a solution and is casual. 
Based on Assumption 1, there exist nonsingular matrices M,N such that 


MEN 


Ir 0 

,MA{i)N = 

Aii{i) 

Ai2{i) 

0 0 


A2i{i) 

A22id) 


MC{i)N 


0 0 


(48) 

(49) 


(50) 
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Let 

^ Pii{i) Pi2{i) 
PU^ P22{i) 

substitute (l50l) and (l5TI) into (l48l) . (l49l) respeetively, we derive 


( 51 ) 


E^P{i)E = {N-^ 

Ir 0 


Ai(i; 

A2(0 


Ir{i) 0 

N-^) 


0 0 


AS(*; 

A22(*) 


0 0 



= N 


-T 


Piiii) 0 

0 0 


N-^ > 0, 


(52) 


N N 

A'^{i){Y^\„P{3))A(i) + C^(i){Y^\ilP{3))C{i)-E^P(i)E 

i=i i=i 


= K 


-T 


w,{i) w^ii) 

w^{{) W,{i) 


N-^ < 0, 


(53) 


where 


N 


N 


N 


W.ii) = A., Ai(j))iii(*) + (??;(*)(^ A., Ai(j))(2ii(*) + i^i(*)(^ Ay A^2(j))^i(*) 

j^l 

N N 


A., A2(j))i2l(*) +ii;(i)(^ A.,P22(j))i2l(*) - Al(*), 

N N 

W^i^) = ifl(^)(^ A., Ai(j))ii2(*) + A’;(*)(E 3., AiO-))A2(*) + i^i(*)(E A.,pS(j))A2(i) 

N N 

+^ll(0(E Aij A2(j))^22(*) + ^2l(*)(E Aii A2(j))^22(*)i 

i=i i=i 

N N 

Ws{i) = i?2(*)(E AyAl(j))il2(*) + A^2(*)(E A., Al(j))A2(*) + Al{l){J2 A.J A^2(j))A2(*) 




J=1 


iV 


i=i i=i 

+^12(0(E Aij A2(j))^22(*) + ^^2(*)(E Aii A2(j))^22(*)- 

i=i i=i 


i=i 


(15^ implies lL 3 (i) < 0. Furthermore, since Aii(j) > 0 for each j E S, we have 

N N 

Au{'‘){Y 1 ^‘Admu(i) + A«Ai(i))Ci2(i) > 0. (54) 

i=i i=i 

Therefore, in lF 3 (i), it is easy to see that 

N N N 

^^2(0(E A*J A^(j))^12(*) + ^f2(0(E Azj A2(j))^2(i) + i^2(*)(E A*J A2(i))i22(*) < 0. (55) 

i=i i=i j=i 
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N{i) = N 


(56) 


From (1551) . it follows that A 22 {i) is invertible. By Definition 10.2 of [fT^ . {E, A{i)) is regular 
and easual. Let 

Ir{i) 0 

~^22 (0^21 (0 ^22 (*) 

we derive 

MEN{i) = 


Ir 0 

, MAN(i) = 

Aii(i) — Ai2ii)A 22 (i)A2i{i] 

^12(f)^22 (*) 

0 0 


0 

In—r('k) 


MC{i)N{i) = 


(57) 


(58) 


Cu{^ - C^2m^i{^)A2^{^) Cum22\t) 

0 0 
By Proposition l-(ii), system (|4^ has a solution and is casual. 

(ii) Now, we are in a position to prove that system (1^ is asymptotically stable in mean 
square sense. 

Let 

x{k) = 6(fc)^]^, 

where ^i(fc) G BJ',^ 2 {k) G then system (|4^ is equivalent to 

iiik + 1 ) = {Ailii) — Ai2{i)A22{i)A2i{i))ii{k) 

+((711 (i) - Ci2{i)A22{i)A2i{i))ii{k)w{k) 

Uk) = 0. 

For simplicity, write 

Ai{i) = Aii{i) - Ai2{i)A22{i)A2i{i), Ci{i) = Cii{i) - Ci2{i)A22{i)A2i{i). (60) 

Substitute (ISTl) and (l57l) into (1^ . we obtain 

N N 

- Al(») ++(»)(^AyAi(j))ii(») +Cf(»)(y]AyAl(j))Cl(») <0, 

j=i i=i 

By (l52l) and (IMl) . it follows that Ai (*) > 0 for every i E S. Define 

V{x{k),rk) = x^{k)E^P{rk)Ex{k) = {k)Pi^{rk)Uk) > 0, 

it can be verified that 


(59) 


( 61 ) 


(62) 


E{V{^i{k + l),rk+i\^i{k),rk = i} - V{^i{k),rk = i) 

N N 

= ^r(fc)|-A.W + +wEA.jA.(j)MiW + c+)(E^-+iW+W+W 

i=i j=i 

< 0. (63) 
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Thus, there exists a positive eonstant 6 sueh that 

E{V{^i{k + l),rk+i\^i{k),rk = i} - V{^i{k),rk = i) < -(5||^i(A;)|p. (64) 

On the other hand, from (l62l) . we obtain 

Xrmn{Pn{rkmUk)f < V{Uk),rk) < A^,,(Ai(rfc))||6(fc)ll'- (65) 

Use (l64l) and (l65l) . we have 


E{V{Uk + l),rk+iMk),rk}<PV{Uk),rk), (66) 


where 


0 < /S = 1 - miur^^si 


Amax ( A.1 (^fc) ) 


By the iterative relationship, (l66l) yields 


< 1 . 


E{U(ei(fc)Ufc|6(0),ro} </9"^(ei(0),ro). (67) 

Therefore, 

E{||6(Ain6(0),ro}<«/Sll6(0)ir, (68) 

where a = "^'^^'^kes^^ax{Pii{ro)) ^ dgg]) , we have 

rmnrf_es{>'minPll{rk)} 

limE{||ei(fc)inei(0),ro} = 0. (69) 

k^oo 

According to Definition 6, (I59l) is asymptotically stable in mean square sense, and so does 
system (l46l) . This completes the proof. 

The following Theorem provides a strict LMI condition for system (l46l) to be mean square 
admissible. 

Theorem 6: System (l46l) is mean square admissible if there exist positive definite matrices 
Pit) > 0, z G S' and a symmetric nonsingular matrix Q, such that the following LMI 

N N 

A'^it){J2\^Pij) + FQF^)Ait) + C^it)iY^X,^Pij) + FQF^)Cit)-E^Pit)E < 0, (70) 

i=i j=i 

holds, where F is a matrix with full column rank and satisfies E'^F = 0. 

Proof: Let X(z) = P{i) + FQF^ in (TTOl) . by Theorem 5, Theorem 6 can be verified. 
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V. Practical examples 


In this section, two illustrative examples related to practical problems are proposed to 
demonstrate the effectiveness of our presented approaches. 

Example 1: Consider the modeling of oil catalytic cracking in practical engineering ( |l6l, 
m ), which is an extremely complicated process when administration is included and its 
simplified form is given as follows: 

xi{t) = RnXi{t) + Ri 2 X 2 {t) + Biu{t) + Cl/, 

0 = R2lXi{t) + R22X2{t) + B2u{t) + C 2 /, (71) 

where xi{t) is a vector to be regulated such as regenerate temperature, valve position or 
blower capacity. X 2 {t) is the vector reflecting business benefits, administration or policy, etc.. 
u{t) is the regulation value and / represents extra disturbances. For convenience, we consider 
the case of M(t) = 0, / = 0, then (ItT]) can be expressed as 

Ex{t) = Rx{t), (72) 

where x{t) = [xi{t)'^ X 2 {t)'^]^ is a state vector. 



1 

0 

, R = 

1 

to 

_1 

E = 




0 

0 


R 21 R 22 


It is obvious that (1721) is a deterministic singular system. However, it might happen that R is 
subject to some random environmental effects ( [|2^ - ll25]l ) such as R = A + C'^noise". In 
this case, (TTIl) becomes 

— ^ = Ax{t) + Cx{t)‘^noise”. (73) 

It turns out that a reasonable mathematical interpretation for the “noise” term is the so-called 
white noise w{t). By (TT^ . we have 

Edx{t) = Ax{t)dt + Cx{t)dw{t). (74) 

In dUl), A is called the drift matrix reflecting the effect on the system state, while C is 
called the diffusion matrix reflecting the noise intensity. On the other hand, it has been 
recognized that, in many practical situations, the coefficient matrices are not constant but 
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random processes whieh ean be modeled by a Markov ehain ( [[T^ . If25ll ). Therefore, we 
obtain the following new equation 


Edx{t) = A{rt)x{t)dt + C{rt)x{t)dw{t). 


(75) 


For (1751) . if we take the following data: 



1 0 


-0.5 

0.7 


-0.2 

0.1 


0.4 0.2 

E = 

1 

o 

o 

1 _ 


0.4 

0.5 

,^(2) = 

0.3 

0.2 


-1 

o 

o 

_ 1 


^ 7 ( 2 ) = 


0.3 0.2 



T 


.F = 

0 1 

,n = 

0 0 





- 0.6 0.6 
0.5 -0.5 

then the solutions of LMIs (1431) are given as follows: 


(76) 



1.7492 

-0.0000 


2.4364 

0.0000 

p(i) = 

-0.0000 

1.9498 

,P{2)^ 

0.0000 

1.9498 

Q(i) = 

-1.1149 

-2.0192 

,Q(2) = 

-0.7417 

-2.8348 


(77) 


By Theorem 3, system (3) is mean square admissible. 

Example 2: Consider a dynamie Leontief model of a multiseetor eeonomy without final 
demands ( (Sll, ) 


x{k) = Gx{k) + E[x{k + 1) — x{k)] (78) 

where x{k) is the veetor of output levels, G is the Leontief input-output matrix, and E is 
the eapital eoeffieient matrix. In eeonomics, eapital eoeffieient matrix E is usually singular 
( [I3, [El, [[38l . If39l ). However, the above praetieal system are often perturbed by some 
environmental noise( [l24l . [l25l ). Suppose that the parameter G is not completely known 
whieh is stoehastieally perturbed with G —)■ G + Gw{k), where w{k) G i? is a wide stationary, 
seeond-order process and G represents the intensity of the noise. Then this environmentally 
perturbed system may be described as 

Ex{k + 1) = (/ - G + E)x{k) + Gx{k)w{k). (79) 


Let us further eonsider another type of random fluetuation. Suppose that the Leontief input- 
output matrix G is a Markov jump proeess whieh ean be modeled by a Markov ehain ( IIT^ . 
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II371, m ), and the capital coefficient matrix is invariant. As a result, the Leontief model is 
generalized to a new model 


Ex{k + !) = (/- G{rt) + E)x{k) + C{rt)x{k)w{k). (80) 

. If for some concrete 


Let A{rt) = I — G{rt) + E, then (l80l) is exactly the same as 
economical problem, the following data are taken in 



0.2 0.3 


0.1 

0.2 


0.2 

0.2 


0.4 -0.2 

E = 

0 0 

,G(1) = 

0.3 

0.1 

,G{2) = 

0.4 

0.5 


0 0 


0.3 -0.1 



T 

0.4 0.6 


,F = 

-0.3 0.2 

,A = 


1 - 

o 

o 




0.3 0.7 


G{2) = 


then the solutions of LMIs dVOl) are given as follows: 


(81) 


F(l) = 


0.9548 -0.4239 

-0.4239 0.3913 


,m = 


0.6976 -0.3940 

-0.3940 0.3284 


,Q =-11.7901. (82) 


Therefore, by Theorem 6, system (46) is mean square admissible. 


VI. Conclusion 

This paper has investigated the mean square admissibility of continuous- and discrete¬ 
time singular stochastic Markov jump systems with state-dependent noise. Conditions for the 
existence and uniqueness of the solution to the systems considered have been provided. In 
particular, new sufficient conditions for continuous- and discrete-time singular hybrid systems 
with state-dependent noise to be mean square admissible have been proposed in terms of strict 
LMIs. 
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